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(54) Encoding and decoding of video images based on a quantization with an adaptive dead-zone 
size 



(57) The present invention enables to control the en- 
coding of film grain information without adversely affect- 
ing the overall coding efficiency of the encoding process 
of video data. For this purpose, a control of the size of 
the quantization interval for the lowest transform coeffi- 



cient values is separated from a control of fitting the 
quantization interval and the quantized value to a prob- 
ability distribution of the transform coefficient values. 
This is accomplished by providing a dead-zone param- 
eter to be taken Into account by the quantization process 
and the dequanlizalion process. 
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Description 

[0001] The present invention relates to the encoding and decoding of motion picture video data. Particularly, the 
present invention relates to a nnethod and an apparatus for encoding and decoding video data, Including film grain 

5 information, by employing an adapted quantization. 

[0002] A motion picture film consists of silver-halide crystals, which are dispersed within a photographic emulsion of 
the film. Each image recorded on the photographic film is generated by exposing and developing the silver-halide 
crystals. In color images, the silver is chemically removed after the development. However the silver crystal structure 
remains after development In the form of tiny grains of dye. Due to the random form of silver crystals In the emulsion, 

10 the grains are randomly formed and distributed within the image. An illustrative example of a grain structure is shown 
in Fig. 1 . A perceivable grain structure is called film grain. 

[0003] A viewer watching a motion picture reproduction does not recognize the individual grains which have a size 
of about 0.002 mm down to above one-tenth of that size. However the viewer will perceive groups of grains and identify 
same as film grain. 

15 [0004] For enhancing the resolution of the images, the perception of film grain is likewise increased. Specifically 
fiJm grain is clearly noticeable in cinema reproductions and in high-definition video images. On the other hand, film 
grain is of less importance for standard television images and for even smaller television display formats. 
[0005] Motion pictures are being adopted in increasing numbers of applications, ranging from video-telephoning and 
video-conferencing to DVD and digital television. When a motion picture is being transmitted or recorded, a substantial 

20 amount of data has to be sent through conventional transmission channels of limited available frequency bandwidth 
or has to be stored on conventional storage media of limited data capacity. In order to transmit and store digital data 
on conventional channels/ media, it Is inevitable to compress or reduce the volume of digital data. 
[0006] For the compression of video data, a plurality of video encoding standards has been developed. Such video 
standards are, for instance, ITU-T standards denoted with H.26x and ISO/lEC standards denoted with MPEG-x. The 

25 most up-to-date and advanced video encoding standards are currently the standards denoted as H.264/ AVC or MPEG- 
4 / AVC. 

[0007] The encoding approach underlying most of these standards consists of the following main stages: 

(a) Dividing each individual frame into blocl<s of pixels in order to subject each video frame to data compression 
30 at a block level. 

(b) Reducing spatial redundancies within a video frame by applying each block of video data to a transform from 
the spatial domain into the frequency domain. 

35 (c) Quantizing the resulting transform coefficients. 

(d) Entropy encoding the quantized transform coefficients. 



40 



(e) Exploiting temporal dependencies between blocks of subsequent frames in order to only transmit changes 
between subsequent frames. This is accomplished by employing a motion estimation/ compensation technique. 



[0008] Among the various video compression techniques, the so-called hybrid coding technique is known to be the 
most effective. The hybrid coding technique combines temporal and spatial compression techniques together with 
statistical coding. Most hybrid techniques employ motion-compensated Differential Pulse Code Modulation (DPCM), 
45 two-dimensional Discrete Cosine Transform (DCT), quantization of DCT coefficients, and a Variable Length Coding 
(VLC). 

[0009] The motion compensated DPCM is a process of determining the movement of an image object between a 
current frame and a previous frame, and predicting the current frame according to the determined motion to produce 
differential signals representing the differences between the current frame and its prediction. 

50 [001 0] Although current video coding standards employ a plurality of different procedural steps to cope with different 
video contents, these standards do not take film grain into account. Consequently, these standards do not encode film 
grain Information. Film grain information can only be maintained when reducing the coding efficiency considerably 
[0011] Accordingly, the present invention aims to provide an improved method and apparatus for encoding and de- 
coding video data, including film grain information, by maintaining a high encoding efficiency. 

55 [0012] This is achieved by the subject matter of the independent claims. 
[001 3] Preferred embodiments are the subject matter of dependent claims. 

[0014] According to a first aspect of the present Invention, a method for encoding video data is provided. The method 
comprises the steps of dividing an image into blocks, wherein each block includes a plurality of pixels, transforming 
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the pixels of a block into transform coefficients and quantizing the transform coefficients in accordance with pre-defined 
quantization intervals by mapping each coefficient value to a quantized coefficient value. The size of the quantization 
interval of the lowest coefficient values is adjusted in accordance with a variable dead-zone parameter. The applied 
dead-zone parameter is included into the encoded video data for a corresponding modification of the quantization 
interval of the lowest coefficient values at the decoder side. 

[0015] According lo a further aspecL of the present invention, an encoding apparatus for encoding video data based 
on image blocks is provided. Each image block includes a plurality of pixels. The encoder comprises a transform unit 
and a quantizer. The transform unit transfonns the pixels of a block into transform coefficients. The quantizer quantizes 
the transform coefficients in accordance with pre-defined quantization intervals by mapping each coefficient value to 
a quantized coefficient value. The size of the quantization interval of the fewest coefficient values is adjusted in ac- 
cordance with a variable dead-zone parameter. The applied dead-zone parameter is included into the encoded video 
data for a corresponding modification of the quantization interval of the lowest coefficient values at the decoder side. 
[0016] According to another aspect of the present invention, a method for decoding video data on a block basis is 
provided. The encoded video data include quantized coefficients. The method comprises the steps of de-quantizing 
quantized coefficients of said encoded video data by mapping each quantized coefficient value to a de-quantized 
coefficient value in accordance with pre-defined quantization intervals, and transforming a block of de-quantized co- 
efficients into a block of pixels. The size of the quantization interval of the lowest coefficient values is adjusted In 
accordance with a variable dead-zone parameter. 

[0017] According to still another aspect of the present invention, a decoding apparatus for decoding encoded video 
data on a block basis is provided. The encoded video data include quantized coefficients. The decoder comprises an 
inverse quantizer and an inverse transform unit. The inverse quantizer de-quantlzes a block of quantized coefficients 
of said encoded video data by mapping each quantized coefficient value to a de-quantized coefficient value in accord- 
ance with pre-defined quantization intervals. The inverse transform unit transforms a block of de-quantized coefficients 
into a block of pixels. The size of the quantization interval of the lowest coefficient values is adjusted in accordance 
^5 with a variable dead-zone parameter. 

[0018] It is the particular approach of the present invention, that the interval size of the quantization interval for the 
lowest coefficient values which are quantized to zero may be set adaptively in accordance with a variable dead-zone 
parameter. The dead-zone parameter is transmitted to the decoder side such that the interval is accordingly changed 

duringthede-quantlzatlonprocedure.Thus.the relative position of the coefficient values with respect to the quantization 
intefval (and the quantization value) and, consequently, the coding efficiency are maintained. 

[0019] According to conventional approaches, a rounding control parameter may be employed to influence the size 
of the quantization Interval of the lowest coefficient values. However the adjustment of the interval size by the rounding 
control parameter adversely effects the position of the coefficient values with respect to the range of the quantization 
interval. The coding efficiency is affected accordingly. In contrast, the present invention enables to maintain the coding 
efficiency by adjusting the interval size for the lowest coefficient values. For this purpose, the decoding process is 
adjusted accordingly. For this purpose, the variable adjusting parameter is provided to the decoder such that the quan- 
tization interval at the decoder side can be adjusted in an inverse manner. 

[0020] By adjusting the size of the quantization interval for the lowest coefficient values, the degree of encoding film 
grain information can be set adaptively. Reducing the size of the quantization interval for the lowest coefficient values, 
preserves the film grain information within the encoded video data. In contrast, an enlargement of the Interval reduces 
the film grain information in the encoded video data. As the interval adjustment for the lowest coefficient values intro- 
duced by the present invention does not affect the adaptation of the quantization to the probability distribution of the 
transform coefficient values, the coding efficiency is not adversely effected. 

[0021] Preferably, the quantization intervals are further adjusted in accordance with a rounding control parameter. 
In contrast to the dead-zone parameter, the rounding control parameter Is not part of the encoded video data. 
[0022] Accordingly, the range of the quantization intervals can be adjusted In two different manners. Firstly, the range 
of the quantization intervals may be adjusted in order to be optimally fitted to the probability distribution of the coefficient 
values for each interval by setting the rounding control parameter. Secondly, the quantization interval for the lowest 
coefficient values may be adjusted by maintaining the adjustment of the rounding control parameter, i.e. preserving 
the achieved fit to the probability distribution. In this manner, film grain information can be encoded without adversely 
effecting the coding efficiency. 

[0023] The dead-zone parameter preferably has a value between a fifth and a half of the interval step size. Most 
preferably the dead-zone parameter has a size of a quarter of the interval size. 

[0024] Preferably, the dead-zone parameter included in the encoded video data is updated every field or frame of 
the encoded video sequence. In this manner a variable degree of film grain information within the video data can 
immediately be taken into account to efficiently control the quantization interval size for the lowest coefficient values. 
[0025] According to another preferred embodiment, the dead-zone parameter is updated in larger intervals, for in- 
stance, for each new video sequence to be encoded. 
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[0026] According to another preferred embodiment, dilterent dead-zone parameters are selected depending on the 
used video coding mode. I n particular, the applicable dead-zone parameter is selected for each macro block depending 
on the type of macro block, i.e. an I type, a P type or a B type macro block. 

[0027] According to a further preferred embodiment, the dead-zone parameter is selected in accordance with a 
detected degree or the presence of film grain within the data to be encoded. Such an adaptive approach allows to 
always select the appropriate dead-zone parameter depending on the currently encoded image content. Alternatively, 
the detection process may only evaluate the presence of film grain in the video data to be encoded. 
[0028] The above and other objects and features of the present invention will become more apparent from the fol- 
lowing description and preferred embodiments given in conjunction with the accompanying drawings, in which: 



Fig. 1 illustrates an enlarged example of a film grain structure; 

Fig. 2 schematically illustrates in block diagram form the configuration of a conventional hybrid video encoder; 

15 Fig. 3 schematically illustrates in block diagram form the configuration of a conventional hybrid video decoder; 

Fig. 4 illustrates an examplefor a relation between an input coefficient value W and a quantized output coefficient 
value W for a uniform quantizer having a step size of A and a rounding control value of f = A/2; 

^'9- 5 illustrates an example for a relation between an input coefficient value W and a quantized output coefficient 
value W for a quantizer having a step size of A and a rounding control value f = 0; 

Fig. 6 schematically illustrates a Laplacian probability distribution; 



Fig. 7 illustrates an example of a relation between an input coefficient value W and a quantized output coefficient 
value W wherein the size of the quantization interval for the lowest coefficient values is enlarged by ap- 
plying a dead-zone parameter 0 in accordance with the present invention; 

Fig. 8a illustrates an example of a relation between an input coefficient value W and a quantized output coefficient 
value W wherein the size of the quantization interval forthe lowest coefficient values is reduced by applying 
a dead-zone parameter 0 in accordance with the present invention; 

Fig. 8b illustrates an example for a relation between an input coefficient value W and a quantized output coefficient 
value W for a uniform quantizer having a step size of A and a rounding control value of f =r a/4 corresponding 
to the rounding control parameter of Fig. 8a; 

Fig. 9 schematically illustrates in block diagram form a preferred modification of a hybrid video encoder in ac- 
cordance with the present invention; 

40 Fig. 1 0 schematically illustrates in block diagram fonn an example of a modified hybrid video decoder in accord- 
ance with the present invention; 

Fig. 11 a illustrates an example of transform coefficient blocks before quantization; 
Fig. 11 b illustrates an example of transform coefficient blocks after quantization; 



Fig. 11 c illustrates an example of transform coefficient blocks before quantization corresponding to the example of 
Fig. 11 a; 

Fig. 11 d illustrates an example of transform coefficient blocks after quantization in accordance with the present 
invention; 

Fig. 1 2 is a flow chart illustrating the process of encoding video data in accordance with the present Invention; and 

55 Fig. 13 is a flow chart illustrating the process of decoding encoded video data in accordance with the present 

invention. 

[0029] Referring to Fig. 2, an example of a hybrid video encoder is illustrated. The video encoder, generally denoted 
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by reference numeral 1 00, comprises a subtracter 1 1 0 for determining differences between a current video image (input 
signal) and a prediction signal of the current image which is based on previously encoded images. A transform and 
quantization unit 120 transfonns the resulting prediction error from the spatial domain to the frequency domain and 
quantizes the obtained transform coefficients. An entropy coding unit 190 entropy encodes the quantized transform 
coefficients. 

[0030] The operation of the video encoder of Fig. 2 is as follows. The encoder employs a Differential Pulse Code 
Modulation (DPCM) approach which only transmits differences between the subsequent images of an input video 
sequence. These differences are detennined in subtracter 1 1 0 which receives the video images to be encoded in order 
to subtract a prediction of the current Images therefrom. 

[0031] The prediction is based on the decoding result ("the locally decoded image") of previously encoded images 
on the encoder side. This is accomplished by a decoding unit incorporated into video encoder 100. The decoding unit 
perfomns the encoding steps in reverse manner. An inverse quantization and inverse transform unit 130 de-quantizes 
the quantized coefficients and applies an Inverse transfomn to the de-quantized coefficients. In adder 135, the decoded 
differences are added to the prediction signal. 

[0032] The motion compensated DPCM, conducted by the video encoder of Fig. 2, predicts a current field or frame 
from corresponding previous field or frame data. This prediction is based on an estimation of motion between current 
and previous fields or frames. The motion estimation is determined In terms of two-dimensional motion vectors, rep- 
resenting a displacement of pixels between the current and previous frames. Usually, motion estimation Is performed 
on a block-by-block basis, wherein a block in a current frame is compared with blocks in previous frames until a best 
match is determined. Based on the comparison result, an displacement vector for each block of a current frame is 
estimated. 

[0033] This is accomplished by a motion estimator unit 1 70, receiving the current input signal and the locally decoded 
images. 

[0034] Based on the results of motion estimation, motion compensation perfonned by motion compensation predic- 
tion unit 160 provides a prediction utilizing the determined motion vector. The information contained In a prediction 
error block, representing the differences between the current and the predicted block, is then transformed into the 
transform coefficients by transform unit 120. Generally, a two-dimensional Discrete Cosine Transform (DCT) is em- 
ployed therefore. 

[0035] in accordance with the H.264 / AVC standard, the input image is divided into macro blocks. The macro blocks 
are encoded applying an "Intra" or "Inter" encoding mode. In Inter mode, a macro block is predicted by employing 
motion compensation as previously described. In Intra mode, the prediction signal is set to zero, but the video encoding 
standard H.264 / AVC additionally employs a prediction scheme based on already encoded macro blocks of the same 
image in order to predict subsequent macro blocks. 

[0036] Only Intra-encoded images (1-type Images) can be encoded without reference to any previously decoded 
image. The i-type images provide error resilience for the encoded video sequence. Further, entry points into bit streams 
of encoded data are provided by the l-type images in order to enable a random access, I.e. to access 1-type Images 
within the sequence of encoded video images. A switch between Intra-mode, I.e. a processing by Intra-frame prediction 
unit 150, and Inter-mode, i.e. a processing by motion compensation prediction unit 160, Is controlled by Intra/lnter 
switch 180. 

[0037] Further, a de blocking filter 137 may be provided in order to reduce the presence of blocking effects in the 
locally decoded image. 

[0038] For reconstructing the encoded images at the decoder side, the encoding process Is applied in reverse man- 
ner. A schematic block diagram, illustrating the configuration of the corresponding decoder, is shown in Fig. 3. First, 
the entropy encoding is reversed in entropy decoding unit 210. The entropy decoded coefficients are submitted to an 
inverse quantizer and inverse transformer 220 and the motion data are submitted to motion compensation prediction 
unit 270. The quantized coefficient data are subjected to the inverse quantization and inverse transform unit 220. The 
reconstructed image block containing prediction differences is added by adder 230 to the prediction signal stemming 
from the motion compensation prediction unit 270 in inter-mode or stemming from a Intra-frame prediction unit 260 in 
Intra-mode. The resulting image may be applied to a de-blocking filter 240 and the decoded signal is stored in memory 
50 250 to be applied to prediction units 260, 270. 

[0039] Referring to Fig. 4, an example of a relation between an input coefficient value W and a quantized output 
coefficient value W for a uniform quantizer is shown. While the input coefficient value W represents that coefficient 
value submitted to the quantization unit 1 20 as shown in Fig. 2, W represents the de-quantized coefficient value output 
from inverse quantization unit 1 30, 220 of Fig. 2 and Fig. 3. According to the example shown In Fig. 4, all Input coefficient 
values in the range of -A/2 < W < A /2 are quantized to an output coefficient value of W = 0. In the same manner, the 
input coefficient values between A/2 < W< 3A/2 are quantized to W = A. This unlfonn quantization, i.e. a quantization 
applying unifomi quantization intervals, can be expressed by the following equation (1): 
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[0040] In accordance with equation (1 ), an input coefficient value W is mapped to a quantization level Z, A represents 
the quantization step-size or interval size and f represents a rounding control parameter. The rounding control param- 
eter f enables to adjust the threshold between two quantization values on the W axis. This will be describe in detail 
^0 below in connection with Fig. 5. 

[0041] The rounding control parameter f is set in the quantization curve shown in Fig. 4, tof = A/2. The function "floor 
(... )" rounds to the nearest integer towards zero while the function "sgn (... )" returns the sign of the input coefficient 
value W. 

[0042] The mapping of the quantization level Z to a quantized coefficient value W is expressed by equation (2): 

15 

W = A . Z (2) 

[0043] The operation of equation (2) is called "inverse quantization" or "de-quantization". 

20 [0044] Another example of a quantization curve is shown in Fig. 5. By modifying the rounding control parameter f, 
the rounding behaviour of the quantization operation can be controlled. By employing a rounding control parameters 
of f = A/2 tor the example shown in Fig. 4, the quantized coefficient values W* are respectively located within the centre 
of a quantization interval of the coefficient input values W. For instance, all input coefficient values between A/2 < W 
< 3A/2 are quantized to output coefficient values of W = A. 

25 [0045] When employing smaller values for the rounding control parameter f, the quantized coefficient values W tend 
to be smaller than the centre value of the interval of input coefficient values W. An the example for a control rounding 
parameter of f = 0 is shown in Fig. 5. As can be seen therefrom, each quantization interval of input coefficient values 
W is mapped to the lower interval value as output coefficient value W. 

[0046] The introduction of the rounding control parameter f = 0 has the following two effects: 

30 

1 . The quantization interval around the coefficient value of 0 is increased. Thus, alt values of input coefficient values 
W between -A < W < A are quantized to the output coefficient value of W = 0. 

2. The values of the quantized coefficient values W ^ 0 are not located in the centre of the quantization interval. 
For instance, the range of input coefficient values A < W < 2 A is quantized to W = A. 

[0047] The video coding standards as H.264 / AVC employ a rounding control parameter f having a value of f = A/3 
in Intra mode and f = A/6 in inter mode. These shifts of the quantization range compared to the quantization intervals 
shown in Fig. 4 aim to better fit to a non-uniform probability distribution of the input coefficient values. The non-uniform 
probability distribution of transform coefficients in video coding can be approximated by a Laplacian probability distri- 
bution. An example of a Laplacian probability distribution is shown in Fig. 6. Due to the probability distribution of trans- 
form coefficients, there tend to be more smaller quantization values within each quantization interval. For this reason, 
rounding control parameters of f < A/2 are employed resulting in smaller values of the quantized coefficient values W. 
The quantized coefficient values are thus not located in the centre of a quantization interval. 

[0048] As the parameters of a Laplacian distribution vary for the Intra and Inter encoding modes, different rounding 
control parameters are used for each coding mode. 

[0049] Regarding the encoding of film grain present in motion pictures, film grain is a temporary uncorrelated structure 
which is not predictable by motion compensation. Consequently, the film grain needs to be encoded in the prediction 
error, i.e. individually for each coding block. An example of a block of coefficient of a prediction error is illustrated in 
50 Fig. 11a. 

[0050] The film grain infonriatlon is especially represented by the small prediction error values which, in turn, are 
reflected by small transform coefficient values. As the quantization stage during video encoding is designed that all 
coefficient values around zero are quantized to zero, the film grain information is irreversibly lost. As long as smaller 
display sizes are employed wh ich are not able to reproduce the film grain information, this quantization loss is intended. 
An example of quantized blocks of transform coefficients is shown In Fig. 11 b. As can be seen therefrom, the quanti- 
zation inten/al for the lowest coefficient values effects that all small coefficient values are quantized to zero. 
[0051] The film grain information can be preserved within the encoded video data by reducing the size of the quan- 
tization intervals such that more quantization intervals are provided. However, such a modification results in significant 
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bit rate increase of the encoding result and a correspondingly reduced encoding efficiency. 

[0052] According to another approach, the rounding control parameter f may be modified as shown, for Instance in 
Fig. 4 and Fig. 5. However, a modification of the rounding control parameter only effects the size of the quantization 
Interval for the lowest coefficientvalues, whitethe thresholds for quantizing coefficient values W to adjacent quantization 
values Is shifted uniformly for all threshold values. This shift of each quantization interval reduces the adaptation of 
the quanlizalion lo the Laplacian distribution. Consequenliy. the quantization error Is increased and the encoding effi- 
ciency is reduced. 

[0053] The present invention proposes a variable dead-zone parameter allowing to control the size of the quantization 
interval for the lowest coefficient values without adversely affecting the mapping of coefficient values, which is adapted 
to the Laplacian probability distribution, in other quantization intervals. As the parameter size can be variably set, a 
trade off between the remaining film grain and the overall distortion can be controlled. 

[0054] A modification of the quantizer's dead-zone size is directly connected to the intensity of the remaining film 
grain. When the dead-zone size is reduced, more film grain Is visible, if, on the other hand, the size of the dead-zone 
is increased, less film grain is preserved within the encoded video data. While current video encoding standards do 
not employ a dead-zone parameter in accordance with the present invention, an optimized size of the dead-zone by 
employing the dead-zone parameter of the present invention can Increase the picture quality of high definition motion 
pictures including film grain significantly. 

[0055] The need to preserve film grain within the encoded video data depends on the particular application. If there 
is no need to reconstruct the film grain at the decoder side, a larger dead-zone can be accepted. By employing a larger 
dead-zone, the number of small and insignificant transform coefficients which are lost due to the quantization process 
Is Increased. If however, the film grain needs to be reconstructed at the decoder side, the film grain reproduction from 
the encoded video data can be Improved by employing a dead-zone of a small size. Thus, by employing a variable 
dead-zone parameter, the dead-zone size can adaptively be set at the encoder and decoder sites simultaneously 
[0056] When including a variable dead-zone parameter into the quantization process, equation (1) is adapted ac- 
cordingly and can be expressed by equation (3) as follows: 
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[0057] The inverse quantization is given by equation (4); 
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[0058] As can be seen from equation (4), the absolute value indicating the quantization level is multiplied by the 
step-size A. To the value resulting from the multiplication, the dead-zone parameter 0 is added. By adding the dead- 
zone parameter 0 during the inverse quantization process defined in equation (4), a reduction of the dead-zone size 
by dead-zone parameter 0 at the encoder side as defined by equation (3) is compensated. While the dead-zone 
parameter 0 proposed by the present invention effects a correction of the interval size for the lowest coefficient values 
at the encoder and decoder side, the rounding control parameter f is only applied during the encoding process and no 
compensation at the decoding side is required. 

[0059] Referring to Fig.7 and Fig. 8a, examples for applying the dead-zone parameterduring the quantization process 
are illustrated. While the example of Fig. 7 Illustrates a dead-zone parameter 0 enlarging a dead-zone, the dead-zone 
of Fig. 8a is reduced by the application of the dead-zone parameter of the present invention. 

[0060] Fig. 7 illustrates a relation between the input coefficient value W and the dequantized output coefficient value 
W. Starting from a relation as shown in Fig. 4, the dead-zone, i.e. the size of the quantization interval for the lowest 
coefficient values, is enlarged by adding the dead-zone parameter 0. While the Influence of the rounding control pa- 
rameter f remains unnoticed at the decoder side, an enlargement corresponding to that at the encoder side is effected 
by the dead-zone parameter also at the decoder side. By enlarging the dead-zone, less small coefficient values are 
preserved within the encoded data. 

[0061] In contrast, Fig. 8a Illustrates a relation between a coefficient value W and the dequantized output coefficient 
value W wherein the dead-zone size has been reduced by the application of the dead-zone parameter 0. In contrast 
to Fig. 7, the rounding control parameter of Fig. 8 has been set to f = A/4. 

[0062] By employing a dead-zone parameter 0 smaller than zero, the quantization interval around zero is reduced 
and less small values are quantized to zero. Although the dead-zone size is reduced, the de-quantized output coefficient 



7 



NSDOCID: <EP 



1564997 A 1 ! > 



EP 1 564 997 A1 



values W are still located at the same relative position within each quantization interval. For instance, the range of 
1/2A < W < 3/2A is quantized to the output coefficient value of W = 3/4A. 

[0063] By controlling the dead-zone parameter 0 the reconstruction of small coefficient values for preserving the 
film grain information within the encoded video data can be controifed. 
5 [0064] Fig. 8b illustrates a prior art example which Is based on the example shown In Fig. 5, however the rounding 
control parameter f corresponds to that applied in Fig. 8a namely, f = a/4. When comparing the quantizers of Fig. 8a 
Fig. 8b: 

1 . the coefficient values within each Interval are located at the same relative position In relation to the quantized 
'^0 value. Thus the mapping of both quantizers is adapted to the Laplacian probability distribution; 

2. the size of the quantization interval for the lowest coefficient values differs. While the conventional quantizer 
(Fig. 8b) applies a quantization Interval for the lowest coefficient values ranging to 3/4A, this interval is adapted 
according to the present invention (Fig. Sa) by applying the dead-zone parameter 0 to A/2. 

15 

[0065] Consequently, the size of the quantization interval for the lowest coefficient values can be changed by applying 
the dead-zone parameter 0 without adversely affecting the adaptation of the mapping to the Laplacian probability 
distribution. This mapping can still be fit to the probability distribution of the coefficients by varying the size of the 
rounding control parameters 

20 [0066] In contrast to the rounding control parameters f, the dead-zone parameter 0 has to be applied during the 
encoding process and, in addition, during the decoding process. Hence, the dead-zone parameter has to be transmitted 
from the encoder to the decoder side. The frequency of transmitting the dead-zone parameter to be applied at the 
decoder may be set, for Instance, to once per frame or once per sequence, etc. 

[0067] A schematic block diagram Illustrating the configuration of an encoder and decoder in accordance with the 
25 present Invention is shown in Fig. 9 and Fig. 10. The block diagrams of Fig. 9 and Fig. 10 denote block elements 
identical to those of Fig. 2 and Fig. 3 by identical reference numerals. 

[0068] In addition to those block elements already shown in Fig. 2, the encoder illustrated in Fig. 9 generally denoted 
by reference numeral 300 further comprises a processing unit 310 for applying a dead-zone parameter to the quantizer 
1 20 and forwarding the applied dead-zone parameter to the entropy encoder 1 90 for transmission to the decoder side. 
30 Alternatively, the dead-zone parameter is not subjected to entropy encoding before transmission to the decoder side. 
[0069] Fig. 1 0 illustrates the configuration of a decoding device corresponding to the encoder of Fig. 9. The decoder 
is generally denoted with reference numeral 400. In addition to the block elements of Fig. 3, a processing unit 410 is 
inserted. Processing unit 41 0 applies the received dead-zone parameter to the Inverse quantizer 220. 
[0070] The processing units 31 0 and 41 0 may memorize the dead-zone parameter for application during the appli- 
es cation period of the applicable dead-zone parameter. In particular, the processing units may memorize different dead- 
zone parameters to be applied for different encoding modes, for instance for I type, P type and B type images or 
macro blocks. 

[0071] While Fig. 11 c Illustrates four blocks of quantized transfonn coefficient values corresponding to the blocks 
shown in Fig. 11 a, Fig. 11 d illustrates four blocks of quantized transform coefficients when applying a dead-zone 
40 parameter in accordance with the present invention. 

[0072] The operation of the encoder and decoder of Fig. 9 and Fig. 10 is described next in connection with Fig. 12 
and Fig. 13. 

[0073] Fig. 12 is flow chart illustrating the operation of an encoder in accordance with the present invention. After 
dividing a video image to be encoded into a plurality of blocks (step S10), the pixels of a block are transformed Into a 
45 block of transfonn coefficients (step S20). Preferably, an orthogonal transform like a DCT Is applied. The interval size 
for the lowest coefficient values around zero Is set in accordance with the dead-zone parameter introduced by the 
present invention (step S30). The transform coefficients are quantized in accordance with the adjusted size of the 
quantization intervals (step S40). 

[0074] The dead-zone parameter may be a fixed parameter or an updateable parameter. When employing an up- 
dateabte parameter, the parameter is included into the encoded video data In order to enable a decoder to apply the 
corresponding operation. 

[0075] The encoded video data include quantized transform coefficients and one or several dead-zone parameters. 
These data may be stored in a memory device or transmitted to a decoder for immediate reconstmction of the com- 
pressed image. 

55 [0076] The decoding process Is next described in connection with Fig. 13. The interval size for the lowest coefficient 
values around zero is set in accordance with the dead-zone parameter received from the encoder side (step S50). The 
received coefficients are subjected to dequantization in accordance with adjusted quantization intervals (step S60). 
The de-quantized coefficient values are transformed Into a block of pixels (step S70) and subsequent blocks are com- 
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bined to form decoded video image (step S80). 

[0077] The quantization of transfornn coefficients applied by the current video decoding standard H.264 / AVC can 
be expressed by equation (5) 

- ((! Wjji'MF+f)»qt>itsysgn( Wjj) (5) 

[0078] The term Wy • MF represents the transfonned coefficients to be quantized, in order to achieve a hardware- 
friendly implementation of the quantization process, scaling factor MF is separated from the transform operation and 
included into the quantization process. Indices ij denote the position of a transformed coefficient within the transform 
matrix. Rounding control parameter f serves to fit the quantization operation to the Laplacian probability distribution of 
the transform coefficients. As the probability distribution may differ for Intra encoding mode and Inter encoding mode, 
different values for the control parameters f may be used for each mode. The » operation denotes a right shift. This 
right shift operation is used to avoid any division operation and enables a simple hardware implementation thereof. 
The right shift operation is equivalent to a division by 2<^^'ts the term abbreviated by "qbits" is expressed by equation (6): 



qbits = 15-1- Jloor 



20 



K 6 J 



(6) 
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[0079] QP denotes the quantization parameter. The function "sgn(...)" of equation (5) returns the sign of the input 
coefficient value. Employing equation (7) 



A=2 



qbits 



(7) 



30 



equation (5) can be modified to equation (8): 



Z^j = Jloor 



35 



u 



V 



•sgn 



(8) 



[0080] By introducing the dead-zone parameter 0 equation (8) is further modified to equation (9): 



40 



Zy = Jloor 



^ 



45 



V 



•sgn 



J 



K) 



(9) 



[0081] By taking equation (7) into account, equation (9) is further modified to equation (10); 



50 



Zjj = ((I Wij-MR-Q+ f)» qbits) -sgn) Wf^ 



(10) 



[0082] The inverse quantization as defined by the current encoding of standard H .264 / AVC is expressed by equation 
(11): 



55 



floor 6 



(11) 
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[0083] The factor 



30 



35 



40 



^floor 6 



includes the quantization step size A from equation (7) and the scaling factor. The scaling factor originates from the 
inverse transform and is not part of the core quantization scheme. For introducing the dead-zone parameter e in the 
inverse transform of equation (11 ) the scaling factor has to be separated from the quantization step size A. in accordance 
^0 with equation (6) the separation can be expressed as shown by equation (12): 

(Of) 

V,j^2'^°' ' =V^^''^.2^^=A. 1/^.2-^^ (12) 

15 

[0084] By taking equation (12) into account, the inverse quantization expressed by equation (11) can be modified to 
equation (13): 

20 W)j=(Zij-AyVjj^2'^^ (13) 

[0085] In equation (13) 

-15 

25 Vij'2 

denotes a scaling factor that orginates from the inverse transform. The dead-zone size can be integrated into the 
inverse transform and equation (13) can be modified to equation (14): 



45 



W.. = (IZ^I-A+0). . 2-'^sgn(Zp (14) 

[0086] When employing a shift operation instead of a multiplication operation of 2-^^, equation (14) can be rewritten 
as equation (15): 

(IZ^|.A-i-0)-l/^.»15.sgn(Z^) (15) 

[0087] Summarizing, the present Invention enables to control the encoding of film grain information without adversely 
affecting the overall coding efficiency of the encoding process of video data. For this purpose, a control of the size of 
the quantization interval for the lowest transform coefficient values is separated from a control of fitting the quantization 
interval and the quantized value to a probability distribution of the transform coefficient values. This is accomplished 
by providing a dead-zone parameter to be taken into account by the quantization process and the dequantization 
process. 



Claims 



1. A method for encoding video data, comprising the steps of: 

dividing an image into blocks, each block including a plurality of pixels, 
transforming the pixels of a block into transform coefficients (W), and 

quantizing the transform coefficients (W) in accordance with predefined quantization intervals by mapping 
each coefficient value to a quantized coefficient value 

characterized in that 

the size of the quantization Interval of the lowest coefficient values is adjusted in accordance with a variable dead- 
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zone parameter (0), and 

the applied dead-zone parameter (0) is incfuded into the encoded video data for a corresponding modification of 
the quantization interval of the lowest coefficient values at the decoder side. 

A method according to claim 1, wherein the size of said quantization intervals is adjusted in accordance with a 
rounding control parameter (f), said rounding control parameter (f) being nol part of said encoded video data. 

A method according to claim 1 or 2, wherein said dead-zone parameter (0) having a size between a fifth and a 
half of the interval step size. 

A method according to any of claims 1 to 3, wherein said dead-zone parameter (0) having a size of approximately 
1/4 of the interval size. 

A method according to any of claims 1 to 4, wherein said dead-zone parameter (0) being updated every field or 
frame of a video sequence. 

A method according to any of claims 1 to 4, wherein said dead-zone parameter (0) being updated once per video 
sequence to be encoded or for every predefined sub-sequences thereof. 

A method according to any of claims 1 to 6, wherein said video data are encoded based on I, P or B type macrob- 
iocks and different said dead-zone parameters (0) are employed for each macrobiock type. 

A method according to any of claims 1 to 7, wherein said method further comprises the steps of: 

detecting a degree or the presence of film grain within the video data to be encoded.and 
adapting the size of said dead-zone parameter in accordance with the detection result. 

A method according to any of claims 1 to 7, wherein said method further comprises the steps of: 

detecting the presence of film grain within the video data to be encoded, and 

enabling the application of said dead-zone parameter only if film grain has been detected. 

A method according to any of claims 1 to 9, wherein said method further comprises the step of predicting the block 
to be encoded based on a previously encoded block wherein said prediction step comprises a decoding slep 
including an inverse quantization step which applies said dead-zone parameter for the de-quantization. 

An encoder for encoding video data based on image blocks, each block including a plurality of pixels, comprising: 

a transformer (120) for transfomning the pixels of a block into transform coefficients, and 

a quantizer (120) for quantizing the coefficients in accordance with predefined quantization intervals by map- 
ping each coefficient value to a quantized coefficient value 

characterized in that 

the size of the quantization interval of the lowest coefficient values being adjustable in accordance with a variable 
dead-zone parameter (0), and 

the applied dead-zone parameter (0) being included into the encoded video data for a corresponding modification 
of the quantization interval of the lowest coefficient values at the decoder side. 

An encoder according to claim 11 , wherein the size of said quantization intervals being adjustable in accordance 
with a rounding control parameter (f), said rounding control parameter (f) being not part of said encoded video data. 

An encoder according to claim 11 or 1 2, wherein said dead-zone parameter (0) having a size between a fifth and 
a half of the interval size. 

An encoder according to any of claims 11 to 13, wherein said dead-zone parameter (0) having a size of approxi- 
mately 1/4 of the interval size. 
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15. An encoder according to any of claims 11 to 14, wherein said dead-zone parameter (0) being updated every field 
or frame of a video sequence. 

16. An encoder according to any of claims 11 to 14, wherein said dead-zone parameter (0) being updated once per 
5 Video sequence to be encoded or for every predefined sub-sequences thereof. 

17. An encoder according lo any of claims 11 to 16, wherein said video data being encoded based on I, P or B type 
macroblocks and different said dead-zone parameters (0) being employed for each macroblock type. 

10 18. An encoder according to any of claims 11 to 17, further comprising: 

a detector for detecting a degree or the presence of film grain within the video data to be encoded, and 
setting means for adapting the size of said dead-zone parameter in accordance with the detection result. 

19. An encoder according to any of claims 11 to 17, further comprising: 

a detector for detecting the presence of film grain within the video data to be encoded, and 

enabling means for enabling the application of said dead-zone parameter only if film grain has been detected. 

20. An encoder according to any of claims 11 to 19, wherein said encoder being a predictive encoder and further 
comprises a decoder for decoding the encoded video data, said decoding including a de-quantizer for applying 
said dead-zone parameter during de-quantization. 

25 

21. A method for decoding encoded video data on a block basis, said encoded video data include quantized coeffi- 
cients, comprising the steps of: 

de-quantizing a block of quantized coefficients of said encoded video data by mapping each quantized coef- 
ficient value to a de-quantized coefficient value in accordance with predefined de-quantization intervals, and 
transforming a block of de-quantized coefficients Into a block of pixels, 

characterized in that 

the size of the de-quantization interval of the lowest coefficient values is adjusted in accordance with a variable 
35 dead-zone parameter (0). 

22. A method according to claim 21 , wherein said dead-zone parameter (0) having a size between a fifth and a half 
of the interval step size. 

40 23. A method according to claim 21 or 22, wherein said dead-zone parameter (0) having a size of approximately 1/4 
of the interval size. 

24. A method according to any of claims 21 to 23, wherein said dead-zone parameter (0) being updated every field 
or frame of a video sequence. 

45 

25. A method according to any of claims 21 to 24, wherein said video data being encoded as I, P or B type macroblocks, 
each macroblock having a different said dead-zone parameter (0). 

26. A method according to any of claims 21 to 25, wherein said dead-zone parameter (0) being part of said encoded 
50 video data. 

27. A decoder for decoding encoded video data on a block basis, said encoded video data include quantized coeffi- 
cients, comprising: 



55 



an inverse quantizer (220) for de-quantizing a block of quantized coefficients of said encoded video data by 
mapping each quantized coefficient value to a de-quantized coefficient value in accordance with predefined 
de-quantization intervals, and 

an inverse transformer (220) for transforming a block of de-quantized coefficients into a block of pixels, 
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characterized In that 

the size of the de-quantization interval of the lowest coefficient values is adjusted in accordance with a variable 
dead-zone parameter (0). 

5 28. A decoder according to clainn 27, wherein said dead-zone parameter (0) having a size between a fifth and a half 
of the interval step size. 

29. A decoder according to claim 27 or 28, wherein said dead-zone parameter (0) having a size of approximately 1/4 
of the interval size. 

10 

30. A decoder according to any of claims 27 to 29, wherein said dead-zone parameter (0) being updated every field 
or frame of a video sequence. 

31 . A decoder according to any of claims 27 to 30, wherein said video data being encoded as I, P or B type macroblocks, 
^5 each macroblock having a different said dead-zone parameter (0). 

32. A decoder according to any of claims 27 to 31 , wherein said dead-zone parameter (0) being part of said encoded 
video data. 
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